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. * I -- - A-^literature review was condu to derive a set bf 

policy imipiications^lor imprqying the effectiveness of ybcatibnal • 
education^ Variables in the areas of employment, ed ucation and 
trainihg^r aiia anciiia.ry ef f attitudes and values^ 

feelings cf sccces^^ and-citizenship) were used to organize, data 
cbllectea__frbm^232_stuaies^ conducted from 1968 thorough 1979 on the 
effects- of vccationai education. The "literature review revealed that 
ibst secohaary and postsecondary- vocational err aduates found jobs in 
traiSin^-related^fieldSi .most were satisfied with their jobs,- and 
most emplcyers wSre satisfied with them. No-consi^tent differences in 
theunemplcymeht rate br earnings of vocational- and nonvocational 
graduates were. ^buM^ _ Further , hbn vbeatibhai graduates -exhibited 
greater academic, abilities. Xhsuf ficient data wjere reported- on 
ccctipational skill attaihmeh^^ j and fewer vbcatibnal education -- 
sttidents planned to attend college. Thus^ considerable uncertainty- 
exists over the Effects of vbcatibnal educatibfr. Policy implications 
for increasing the effect ivegess bf vbcatibnal: education include the 
following: -standardization of ^research methbdblcgy and reporting of ' 
^esultSr fflor^ precis^ description bf educatibhal prbgrams^ 
establishment of the validity of survey. instrument s ^ and development 
of a way to account for the lack of ^eguiyalency in the types of jobs 
held by vocational and nonvocational graduates. CHNI 
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POLICY IMPLICATIONS FOR i^fiPSOVING THE EFFECTIVENESS 
. . ' OF VOeATIOML EDUCAfieN 

by Donna M; Mertens i 

i 

Request for evidence oh the effects of educationaiprogr^Ssare. being 
made with increasing frequency. Those who must decide how public funds 
are to be, used need more and better information to h^lp them choose among 
competing .altetnatives. Vocational education, -because of its apparent 
j^otential to deal with many of the hatidh's' serious problems, is especially 
^^i^gj^^H?^ upon to demonstrate /the effects. it can produce. The effects, 

f ^om participatibri in vocational education are probably the. 
most debated policy , questions relevant to vbcatibhal,' education. ^ , 

Th many possible butcdnies of vbcatibnal educatibh. Lee (1978) 

Suggested that -multiple outcomes fotec educatibnali and sbcial 

benefits sfij^uid be used V The following rationale was used as a basis fbr 
selecting tthe outcome variables that were included in this study. 

Since the Smith-lfughes_Act-^of _ i§17^^provided the first federal funds 
for secondary sqjiool programs. in.agriculture, home ecohdmics and trade 
and industrial eHucation, preparation for employment has been seen as a . 
major goal of vocatLonal edtication,_ *The-i976 Voc Education Amende 

mehts specified two criteria that_each stateis^tb use to evaluate each 
program " — which purports t^o impart, entry level job skills According to. 
the extent tb which progra^ completers and leavets - ^ 

. ' - _ ' : : . j: _. _ . ._ . _ ._ _. 

' Ci) find employment iii occupations related* to training, 

and;.- j • ■ 

Cii) are cbrisidered by. their employers ' to be well-trained and 
prepared fpr employment ... 

" - . / ' . ■ ^ : " 

' Section 112, in addition tb specifying t?ijo criteria by which, program 
completers a:nd leavets ' lhall be evaluated added the phrase ".. .except 
that in no case can ^pursuit bf additibhal: education' or "t^^ning^ by program 
completers or leavers be Qbnsideredjheg^tivi in these evaluations." - Thus 
recpg^izing that ^vocational p to grams prepai^e students, for, additional edu^ 
c;^iort or training as well as fbr entry' ititb the labbr mafket. \ 

• In addition-tozits* explicit educatibn and emplbyment bbjectives^ 
vocational Education has always had^a mdte bt less 'diffuse set bf ^bals 
related^ to_personai-^growth and citizenship. Vbcatibnal educatbrs have 
long claimed. that. the_special features of theit ptdgtams ptbvide unique 
learning opportunities, especially for students whb find little bf meaning 
and few opportunities for accomplishment in academic classtbbms . --^^ 

_Based oh, vocational education *S-iegislatidn, goals/^arid bbjectives^ 
three categpries of outcome variables were chosen fdt Mtcltisidn in this 
study: employment, education and training, and ancillary kffects. Table 1 



lists the "basic dependent varialjles- whiSjh were Iseiected to organize the 

Methodology \ 



suinmary of findings presented in this report: ^ \ 



The policy _iinpiications_reported in this paper\are derived frcS a 

literature review which. attempted to assemble and s\5ranafize all studies 
that could be obtained on the effects of vocational education that were 
Ireported from 1968 tRrough 1979 (Mertens et al>. , 1980). The specific - 
Isources of Ihf birinatibh ihaluded card catalogues, computer searches ^ existing 
>ibiiographies, direct solicitation of reports and consultant :recoinmenda-:_ 
lions. The computer searches inclujied the^fbllpwing^data bases : _ERIC/CIJEi 
dissertation Abstracts ^ AIM/ARM, National Technical Information Systems, * 
ipd the Smithsbhiah Science Ihfbrmatibh Exchange. 

— -- - 

-This extensive search of published sources and sdlicitatidn of Utl- 
^liblished reports" yielded a total of 1*489 uhduplicated titles . After 

relevant studies were eliminated arid the remairider screened, a total of 
23I? titles were used as basis for the report. 

W _ ' _ . _ ■ : _ 

\\ Despite all these steps, some studies were prc^bably not identified and 
sbtne which were Identified were not obtained. These otnmissions could have 
restl^lted from several causes. First j a study may not^have been Identified 
Kecause it was not entered into the literature bases that were searched. 
!pf a study has been entered, it way not have been indexed^with the dis- 
cjiptions that wiere used in the computer search. -Individuals-who-were ' 
contacted concerning the unreported research may not have responded to the 
r4quest^ -Second; a study may havebeen identified, but a- copy could not 
b4 obtained. -Th|^rd, a study may not hSve been included in_ the review, even 
iff- it were - identified- and obtained^ - because it was mis classified- when, it - _ 

f reviewed. -These miscl^ssifications could result from judgmental- errors 
ti a study did cnot _ contain data- on relevant variables or that it did not 
re^r to public * vocational education, ^ 

Because omissions arising from^ such causes, no claim is made that 
the review on yhich these poli^cy implications are based includes all 
studies reported since 196o. It contains all those that ah extensive 
search could lij^ate, but bmlssibns undbubtably remain. Readers will have 
tb judge for ti^emselves whether the inclusibh bf such bmitted studies ^ 
wbi^ld sighif l^ntly alter the cbhclusibhs derived frbm the studies that « ' 
were reviewed ^ "v 

! ^\ Results bf the Literature Review 

The empfeasis iri this arialysis was tb summarize across a large riut^efl: 
of studies to determine if there were cbristajit firidirigs with regard to ^ 
selected vafi^ables. The emphasis was riot on critiquirig" the quality of the 
studies or on develbpirig a coriceptual mbdel for evaluatidri bf vocational 
educatibri. - The fifteeri dependent variables were useii a^^a framework for 
brgariizirig ^the firidirigs. Iri additibri, the studieis bf secbridary arid post- 
secbriqary studies were reviewed separately. A brief summary of the 
results of the literature review follows. ■ ' \ 
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TABLE i 

MAJOR SETS OF DEPENDENT VARIABLES 



Type/Class 



Variables 



i. Erap.ioyment 



1 1 . Educat ion/Training 



Ancillary Effects 



A. Emplbyiuerit-Uhemployinent 

B. Occupatibh related to training 
C. 



D. Employee satisfaction 

E. ^ Employer sat i&f action 

A. Basic skill attainmient 

B. Academic abilities - 
e. Attendance and dropout 

D. Occupational skill attainmient 

E. Continuing education 

F. Satisfaction with training" 



A. Aspirations 

B. Attitudess and values 

C. Feelings of success 

D. Citizenship 



3. 



No differences in urieinplbytheht rates were found for vbcatibrial and 
ribnvbcatibrial high schbbl graduates. Pbsts«bndary ybciatiohal graduates 
generally had lower uhemployTheht'" rates than did their vocational peers. 



— \ - 



A majority (over 50 percent, usually clbs^r to 70. pefceht) of 
secondary and pdstsecbndary vbcatibrial graduates bbtaihed jobs in train- 
ing-related areas. *l 

Mixed results were repbrtea\fbr earriirigs. Sbme studies reported* rib 
differences between vboatibrial arid ribrivbcatibrial graduates; bthers re- . ^ 
ported an initial earnings advantage fbf vbcatidnal graduates which 
disappeared over time- Trades and industry graduates at the secondary 
i^el and technical graduates at- the p^ostsecondary level consistently 
ha<S higher earnings than graduates of other vocational programs. 

A majority of employers _were satisfied with vocational graduates; 
a majority of vocational graduates were satisfied with their jobs. 

^dUcatibri ^ 

Mixed results were reported for ba:sic skill attainmerit and academic 
^atjilities^ althbugh vocational students appeared to be below academic and 
above br the same as general: curriculum student The mixed nature of: the 
results are exemplifj.ed by the fbllowing studies ' findings . Custer (19735 i 
usirig the Starifbrd Achievement Test, found rib difference in the mathematics 
scbres of cbbperative arid ribri-cbbperative educatibri students. He did firid 
the cbbperatiye educatibri studerits scored higher bri the^ readirig pbrtibri 
of the test. This cbritrasts with the firid irigs bf Horvath (1973.) who used 
the Americari College Test (ACT) . He fburid that vbcatiorial-techriical 
studerits were more proficierit at mathematics arid less prdficierit iri 
Eriglisn arid Social Studies thari their cbllege-pf eparatbry peers. To ^ 
further confuse the issue,' Perkiris C1973), using the Basic Educatibriar 
Achievement Program test battery, fourid niJ difference iri reading and *^ 
mathematics scores *feetweeri vocational and rionvocational groups, but that 
the vocational students scbred higher on the vocabulary portion of the 
test; 



-- Insufficient d«ta were -reported on occupational skill attainment 
to draw- any conclusions (although employers reported being satisfied)^ 

The type of data available on this topic included such studies as 

Farrington <i974> and McQaay _ (1974) Farrington*s_study compared teach- 
ing strategies in an agiricuiturai mechanics coarse , and included no 
appropi'iate comparison. group. McQuay looked at the effects of one versus 
two years of training on.shop achievement, thus also not including an 
appropriate comparison group. 

Insufficient data were available to determine if vocational 
education helps to retain drbpbuts. At the secondary levels mbre males 
thari females drop-but; a higher .percentage of distributive erirollees 
drbp-but thari bffice education erirollees. Work experience appears tb 
have a positive influence on keeping studerits iri school. Value systems 
bf drbp-buts arid graduates appear tb differ. 
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: About diie-third of vpcatidhal. graduates cbritihued their education 
beyond the secondary levels whilfe almost tvzice ss many nonvocationai 
graduates did so. Vbcatibhal graduates reported being satisfied with their 
training. * ' . 

Ancm ^jry Effects . * 

__) . _ _ / _ 

Fe^er vbcatibhal' than hbnvbfcationalstudents^ planned to attend college 
(usually 30 percent fbr vbcatibii&l and 60 pereertt for riohvocatiohal students). 
Vocational stu^ehts repbrted feelihg gbbd abbiit themselves. This was evidericed 
by their response to such items as "I take a pbsitiye attitude tc5ward myself." 
Civic activity (e.g. voting) was ihfrequeht fbr bbth vo^atibhal and nonvoca- 
tionai graduates. 

Policy Implications ; 

The policy implications derived from the literature review reported 
above include the following: 

1) Considerable uncertainty_^existS-Overjust-what- effects can reasbhably 
be attributed to participation in vocational education.^ Esiimating the iong- 
rarige effects of any education experience is probably themost difficuitprob- 
lem in all of educational ' research. When the outcomes of interest are.snbject 
to many influences over. which the education program has ii£tie or no control, ^ 
the difficulties are multiplied mariy times. Questions can be raised whether 
ah5r educatibnal experiehces can produce effects which are powerful eriough^^to 
be detected with existing research methods. 

___ ■>_-_ -__ _ : _ 

2) The studies i^^liich were assembled varied widely bri virtually every dimen- 
sion. What is surpt^isihgi giyeh the_ variability in the studies and in the 
programs they examined, is the similarity bf results they yielded with regard r 
to emplbymeht and the relatedness bf emplbymeht to trainihg. Thisf is riot to \ 
say they all yielded similar results. The degree bf c'lusteririg df^es^ however^ 
suggest that these studies are reflecting results that are usually produced 

by -vocational programs. The alternative explahatibhs - that thede studies 
are all reflecting systematic error -^seems uhlikely giveh their wide variabil- 
ity. ^ • ,;, ■ ' 

■ . -I • 

3) Despite the difficulty of- the the research problem to estimate Ibhg range 
effects -and-despite weaknesses in the separate studies, 'as a body these studies 

some, effects th,at seem highly likely to have resulted from partici- 
pation.in vocational leducatian. Sufficient evidence exists to indicate that 
^?^z^?^^^z?^i^^^zP°^^^^^°"^?^y level) participation in vocational education 
is associated with higjier. levels of employment, inaddition, most vocational 
students are obtaining jobs inthe occupational areas for which th^y are- - 
trained. This suggests. that these former students are Heing hired f or. Jobs _ _ 
that require specialized training. Finally; the preponderance of the evidence 
suggests that employers are satisf ie^wxth vocat^nal graduates and that ' these 
graduates are satisfied with their jobs and their training. 
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4) Beyond the consistently-reported findings described above^the evidence 
is not SC5 encouraging. The research methpdblbgy arid the reporting :pf results 
contribute to the inconsistency of findings among studies arid the difficulty 
of -drawing meaningful conclusions cbncertiirig the effects of ypcatiprial edu- 
cation.- -If _ future research is to be used f or /'f brraulatirig policy which will ; 
resuit.in an iraprovenient of vocational education, specific chariges in the 
methodoiogy-and reporting practices are needed. In terms of repbrtirig re- 
search^ -more emph^is . should be given to describing the educatibrial program 
;in_order_ for- researchers to know -What the "treatment" actually is. Methods 
for classifying stqdents as vocational, academic and general need mbfe 
attention* -Use--of actual , transcripts with decisidn rules can irisure a more 
accurate classification^^ The reliability- and validity of instruments should 
be established and reported. _ More- attention should also be given to re- 
porting contextual factors which influence the- effects - of - educational pro- 
grams (e.g. unionization in specific occupations and- economic conditions^ 
iri communities) . Researchers should report.the methodoiogy-more-completely 
arid clearly, including sample size and res^ponse. rates.- -Dependent- variables 
should be chosen intelligently in order for them to represent _ legitimate 
bUtcbmes for vocational education. If sound conclusions are to Se drawn 
concerning thfe effects of vocational education, sound research must be 
more pervasively cbriducted, reported and disseminated. 

5) It has been recognized that all research- reported- since 1968 was-undoubt- 
ably riot included in the review on which these policy, implications -are _ based . 
While this last policy implication concerns' areas in need of farther- research, 
it is possible that such research has been done and the^need is for better 
dissemination bf the results. Nevertheless, based on the current "state of 
the ^rt", further research is necessary in the following areas before _ policy 
^^^^^lished ^ that will result iri iihprovirig vocational education's 

' ^^^^^^3^^"^^^- "^^^ effect of vbcatibrial education ori special needs groups 

handicapped and disadvantaged emierges as an area in need of further 
res.earch^^- In addition, the area of equity for bbth^sexes and all.races is an im- 
P?^^^"^_^^?y^::^" "^^^^^ research. Less research was fgurid for postsecond- 

w^ry than secondary effects,, especially at the riatibrial level. 

In^ the^empiQyment_^area, the definitions of emplbyinerit and uriempioymerit 
present a problem. Standardazation of definitibri w»uld. irisUre that results 
: are comparable across^stndies^-This was also a problem with the earriirigs "variable. 
Because earnings is_ an important indicator, increased research shbuld be urider- 
takeil to improve the reliability of this measure. Comparisons bf male arid fe- 
male earnings underscore^the_ importance of the equity issue. The. variable 
"occupation related to trainingV raises" the -question of how specific trairiirig 
should be, ^ particulary at the secondary -level . The research>.questibri bf 
interest is: '"Should emphasis be given to - training students in specific 
occu|>ational 'skills or in more general employability skills?" 

- : - ^ * - - - . _ _ . . _ 

_ ^Measures of ; employer satisfaction are. confounded. because of a lack of 
equivalericy iri the types of jobs held by vocational and nonvocational graduates. 
Future research of employer satisfaction should explore ways to account fo^ 
this variatibri. 
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The attainment of basic skills is, ah area_ih_heed c?f further ireseairch 
from two perspectives. First, the current level of ; attainment should; be more 
carefully studied, and second, the proper balance in the curriculum between 
basic skill and occupational skill attainment should be explored. Better; 
measurement and reporting of occupational skill attainment is also heeded. 
The areas of attendance and dropout heed additidhal research ^tb ahswer the ^ 
question "Can vocaticpal educatiiDn retaih students in school who tni^ht 
otherwise have dropped out?'^ Also, .what can be done to help dropouts after 
th^ have left school? The high rates of dropouts for mihbrities ahd those 
enrolled in nontraditional programs is another area of concern. Another 
qnest±on_in need-of research is "What role can cbuhse'lihg play in reducing 
the dropout rates?" Two additional areas of research are related to the 
continuing education variabie.u Examination - of and control for cbntinuing 
education activities -oa^t-side Ehe. traditional school systems should be in- 
cluded in future research .-jTh^ _ other question concerns the degree of prepar-* 
edness for postsecondary ^;education that is experienced by secondary vpcationa 
graduates. " ' • 

;_A much .smaller body; of ^ta was located for inclusion in this review for 
ahcilla-ry effects thah^for eilucat'ion and emplo'yment. If the areas aspirations 
attitudes and values^ fQ^l^hgs of success ^ and citizenship are judged th be 
impdrtaht effects bf vbc^^y6g.rial education^ then these areas are in need of 
further -research. ' - 
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